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_ Evaluation, ag‘one ‘component of an instructional progrem, haa not attained. 
‘its full potential for asaLeting deci sion-makere, primarily becaues it is still 
viewad as an extraneous activity by many. Evaluation generally has consentrated 

n supplying information to high level adniniatratora,: heglecting’ those most - 
Be responsible for thildren-in the echooles If an -avaluation ia to be made 
maaningful for improving the quality of the educational. process, all decision: 
makers within a school district must be served, This includes not pnly district. 

| administrators and boards of education, but also a SROSEFOD teachers, - nut being 

“principals, and curriculum specialists. j 

q 

‘Evakuation ‘is generally accomplished primarily through the use. af, Spendecdized: 
achievement. tests that’ provide content. area scores which.are compared with a abz0d | 
average Or norm group averagese The grade aquivalent unit of raporting ‘is commonly 

-wsed, which tells, whether students hava performed at, above, or below grade level. 

Although such information is, valuable, it,does little to halp classroom teachers ° 

make decisions or plan more- Bppeopane se programs. ; 

To make avaluation a more nearingfup process, an assessment was conducted 
‘of ESEA Title I reading: ‘prograns duping 1974-75 by the Vermont ‘State Department . 
of Education, not only to evaluate tha success of the programs but also to assist | ° 
classroom teachers in improving inatructional programs. .The Prescriptive | ‘Reading 
Inventory, a criterion-raferenced reading test published ‘by. CTB -McGraw=Hill, was 
udministerad in September and May to nearly 5G00 students involved in’ Vermont Title 
I reading programs. The results provided teachers with individual student pre- - 
scriptions for instruction. Workshops were then held thrdughout the: State to. 

“ instruct teachers im the use of scoring Teports and to aseist. them in satting’ up 
and managing an individualized ins tructional program. The: ‘teaulte of this project, 
are reported in ae document « oe Pig te 
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/ Raquest for Participation -- summer 1974 / | oe 
Thu ESEA Titdu 1 stuff in the Vermont’ State Dapartmant af Education contacted. 
"bine val Loys ‘supurvisury undone which: hed proposed Title 1 rewding programs far thu 
1 Asta schoul yude tu participate in the PAL. taating program, forty unions agreed 
Lu purtielpatd tn the program. Thesw uniond are listed in Appendix Ae In wddittons . 
fluy untons agreed to test children in a achool which woe not dnvélved ino Title - 
1 ruuding program to provide a reference group which might bo used ago control, 
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.._ The. Prescriptive. Reading ‘Inventory (PRI )* was administered in Sepfember to 
3764 students (Grades 28) wito wapa: involved, in supplemented reading programs 
“supported through ESEA Title Is These tests ware adminiatered hy local educators - 
Collactead by the state Department, and sent out for machine seoring. : 
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pretest feedback == uot 


ber 1974 Aa ep. | ( 

e.. tes : ’ Ope tk a eee one Sea: 4 
““.. Pretest data was returned to each participating district for use in planning 
learning programs., Such data included diagnostic mape “for aah student, class 

diagnostic maps, individual study guides, class grouping reports, objactiva mastary 
reports, and ‘district summaries. ‘These reporte taclassifiwd tha saven PRI ‘skill =~ 
afeas into four areas-designed for Vermont: which ara more eeadly understood. Thase - 


skill ureas are: . Word Attack Skills, Language Skills, -Vacebulary and, Comprehension, 
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1 *. 


Objective Ranking ~= November 1974 ph ae i. Moe al 


» +The PRI series ‘tests 90 reading,objectives on four lavels, Each level testa 
35 to 40 of. these objectives.’ Each participating supervisory union was supplied: 
“with 4 set of indices ranking the instructional emphasis (heavy, moderate, light) 
‘ given aqch objective at seach grade level. Theses: indices Fapkewented tha state ~~ «| 
inaitee ecoording to last. year... The supervisory unions ware! aakad to update these . 


indiges according to their own emphasis. Cates 
ek OL : * = eg ee 8 . 
Workshops == -November 1974 ° 7 ign og . 


A series of. three similar workshops wereconducted by @ faprasentative ‘of the ~* 
test publishars at three sites in..Vermont; Essex Junctlon, “Qurkey and Woodstock. 

' Thres workshops concentrated .on the.use of PRU test resulta Por diagnosing reading 
deficits, the use,of prescriptions in- planning reading instrvetion, ideas for -a 
‘resource file supporting the PRI management system, suggestions for class organi- 
zation ard lesson planning, and suggestions for improving: canhnunications with the 


regular’ classroom teacher. 7 en . re a 


ah 


LEA Staff Intervigus -- March & April 1975 


A series ‘of interviews were conducted by a State Oapartmenh Administrative Intern 
in a randomly selected 25% sample of participating school districts.(N=10) and in . 
-dll six reference schools to determine. their perceptions af tha project and solicit 
- Suggestions for’ isprovements. ‘In each ‘district, the Title I. contact person was 
inturviewead, along with a.randomly selected 25% sample of beaghers and aides in each 


scnool who worked with Title I children. | 
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*’ the ‘wreuané trond in’ "oluoakion ie to focus on ‘maximizing the notentiad, oF, eee 
the individual dtudent. Thies trand has crested new neadss nongraded clasatoons a 
and schools, methods Por detarmining the: needa of anne wet students, end individualized 
sna tRuetsion to moat, thooy ngadae . roa pa 

fhe cr,turton=rororangad* toot waa se ualenau ta help moot these ‘hoedss ‘Ruthox, ye 
than comportng o vtudoAb"s performance with thet-of a national group in a brond , 
‘uubjuct area, a cfitorLon-roferencad teot evaluates & etudent'# mastery or non= 
mautury of explicit aducational ob fectivos. that ard atated in behaviore, ‘torma. oats 
Every, test item Ae conctived to test mastery of thaeg ob Jactivos. a 
/ : ae aha G _- 

cat onal. ob foctdyo. defines an intended outcone of struction Stated - 
‘in bohavioral/torms, it describes the specific ways in which a student's behavior 
is ‘expected fa be changed by instruction in tha Glasaraom. It. identifies tho * 
behavior, déPines the conditions under which the behavior is to aoour, and oftén. 
describes the criterion, or standard, of acceptable. performance. Thus, a criterims 
Toforonced tast is an inventory of desired atudent behaviors in a erp peer, area. 


_ giPle intended to offar an inventory of. the reading behavior of ‘etud nts: 
: Hircushou the elementary school years. The.objactives measured are those /typical — 
of reading curricula across ‘the nation. _ The test comprises four successive lovels : 


as Pollows: mo ey 
i : * : ‘ , Level. al , it wt IGOS 4 ades 7 
| | os Red (A) 7S we 208 a 8 
‘ - Green (B) 200 be ae = 
Blue (C) 3e0 = 465 7 . : 
Wranga (D) 460 - 605 . 


Ninety oh jeotives are measured “by the test with considerable overlap from 
level to leyel. The number of objectives measured at each level is Red-«34, 
Graone~41, Bluow42, and Otange~-38s. Each objective is measured with throe.or 

= four ‘Ltoms » ; _ - Boe 


PRI dqges not provide a means fdr comparing student performance with that’ oi 
a standardization sample or. norm group. Rdthar, it 4s designad to provide evaluation 
Tolevant to classroo insttuction. That is, it shows which objectives the student 
has mastered and sna objectives the student. needa to review to progress in reading. | 
In addition, PRI uhcdurages practical use of this information by prescribing class. ~~ 
‘room instruction that can result in substantial Pengeiet ton in areas in which the 
pom sudens is daficients "| 2 Rae, : iy , 
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Report Forms 


Each student's performance on PRI was reported on an Individual Diagnostic 
Map. Two individual. diagnostic maps were used in tha project. The first map is 
a stundard part of PRI; thea second is a customized map that organizes test results 
into a special format and reports in the areas of vocabulery, comprehension, word 
. attack skills, ‘and cad skills. Appendix 8 contains samples of the two MAPS » | 
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ag tho um ur ant) borsohkage of etudontu ee ‘auch. ob jective fay Cog: ond : 
bout ‘Lavel) word Loported For vach suporyidory union ahd the’ total state on tha .~ 
ig ana Ofstrict Diagnostic. fap. A special Vormont form was developed to. Feport ~ 
he. four skills areas, proviously men thLonade Appendix o ih eal: a semp ia, ee 
dtvkeiet aummary. : . fe. . . om 


District Re Or ting, form | . ee | *  & i 


‘Appondix E contains the set’ of forms and’ ine trugej ins duicies for each 
Supervisory union to report protast and posttest results. — “The-forms were made 
into a boaKlet, and one booklet was, supplied Fox each grade. ; 
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IV ACAD ENE & F INGINGS: 


. Section IV reviews the results of the 1974475 PRI test pTogtans for the 
total state popydation, rather ‘than isolated data fron individual Supetyisory 
unions. .The amadyslis coyors only Title 1 students who took both tho pratest—-and 
. “posttest. hetg thé conaLyoLe treats resulta fron grade and BRI lavols senate taly, 
thooa lowoks whoo lose than 25 sctuconty on Atutowide basis wera involved, ware 
M0t imcludad, as Wo aa 
: ; 
'. Gradus Tested by PR _Love 1 
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In Section [II th 9 Sugg 08 Sod “grades Wore given Por the four PRI Loyels. 
, Because the Tithe | students ara bel weaverage achievers in Reading » trchers 
were allowed to select that PRE level uttch they Palt was most apprepriate for 
each child in their class. IN Somse cases,» different children -ino class wate tested 
with threo Zeyals of tho PRE. the'actual range of grades tested with wach loyol 


of the PRI Zs shgan below s : Pi ; 
: Actual 
PRE Level * Grades’ Tested 
Red es , 253, 4,565? 
Green — 255, 49556 ; 
Blua a 395, 57,8 foo 
Jtange 5 »6, 7,8 


_ fable. lists, by “grade ong pA] lovels tio mumber of matched ca ses (Students 
U0: toGk BOER Ehe pratest ang pottest) and tha parcentagoa that this number Taptesents 
OF tho ‘pretest population, For x2np ley ir Grade 2 Red there wore 48 matchod casas 
which roprdsont ?3% of the 6G3 chi Lde on. who were protested. 


‘Ranking of Obijesti yes. ; - . . / 


‘oo Im tha fall) sach Sipetyisory undon was supplied wlth e Set of findiciios 
Tanking the Sastry ctional emphasis gLwen each PRI Objootive at coach Cade level, 
These indi cies ={pTesinéed tha state average tankings from the previcus years. The 
\l-5 wos defined a8 follow: 


n Eating of "1" indicates an objective ePucial to the reoding process for 
Title I ‘Students, and Qo that teichers strive to teach for mastery et each Ota da 
level where this tating is assigned. ‘ 


ye 


eat importance and one that tha 


‘ ) rating of "2" indicates an objective of or 
tian. 


feachors/will strorsghy emphasize in th ei imstruc 


A gating of "3" ddanti fies’ an obj active oe moderate impottanca amd tne to 
Which teachors will gdve some fmphasis im theiy imstzuctionad acti vitdes, 


aM ao oe. ; 
a "4" tating §ibrals ‘an objective that has Little importance to the treading 
Pfocoss for TitlLa ~ children amd oe that the teachar will imclude on a tipso 
dvadlable pais oly. 


A "S™etlng indicatis on otr joc tive of no importance to the Title | Student 
and one that the boadhor Wilmot teactiat the grade where the rating Is 9f ven. 


~ An 'X" rating Endiceates an oajective which 18 not tos tabi by thot parti cuzar 
PRI leval, ; . : : ° 


foo 
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fach district was asked to update these statewide rankings according to theiz 

_ own reading program amphasis, State averages were again calculated, based upon the 
ravised riutifigs Supplied by participating d Betrice, Although individual districts 
dndicatud their awn omphases variod from the Atato aS a whole, the stato avers qed 

“Wid not chongo for any of the objectives. To simplify the rating scale, the 5 

pOlNl scalo way ‘condunsud Inte a 3 point souls, with "1" and "2" ratings boing ’ 
canmbinud iryto a “houvy umphoodid' catugory, 3" und ~_* ratingo being combined into 

al “moo xin t onphusis", and "5" ratings buliag ddontiried as "light omphasLo",. 


emphasis for each ‘grade and PRI Level which was used to test 25 or more Students 

on a statowide basis. It is interesting to note that the relative number of 

objectives receiving Light omphasis increases somewhat as the grade levels become 
Highere -In each case, however, the numbers: of obfectives receiving high and moderate 
emphasis far’ outwaighs the™Light emphasis, supporting the content validity . of the PRI for 
Vermont Title I PEnuenS r. 


fan reports tha number of ob joctiyas receiving heavy, moderate end light 


The Ta ting indices for each objective, by grade and PRI level are presentod 
E> 


. 


Using the Vermont classification of PRI oyjectives into Pour sleilI arcos 
(word attack, language, vocabulary, and cOmprahens Lon)» Table 3 indicateg the 
number of ab jectivas Ln auch category measured by each PRI Lovel.e The table 
Shows tha percent of yocabulary -ob joctivos remyins fairly constant through the 
PRT lovals, the percent measuring conprehonsian increases, those maasurding Language 
~kills dacrogse, and those measuring word attack Skills decreases slightly excapt 
ut the Grocn level. , 


Tes L Results 


Ficase 1 graphs the PRI pretest and posttost scores for all Title I child 
dren, for each of the four skill areas, Crowth over the year from September to 
vay ds shown by the difference between the ore and pogt scores. The scores 
Cepresent the average porcent of emphasized objectives mastered by Title I childrm. 
Tha graph shows a polit ively constant growth For each skill area of batweon 23% 
and 20% The throe skill areas of word attack, lamgquage, and vocabulary show 
Colatively equal degrees of mastery for both pre and post scores, but canprehenbicn 
scores Lag Il5~ to 204 bolow the other three. 

Figures 2 through 68 show the sama information as Figure,l, except that thay are 
prasanted by grade and PRI lavele At each grade layel and feck PRI level, comprehan= 
sion subscores lag behind the other three skill area scares The reader should note 
that where two levels of the PRI wore used at the Same grade level, as in grade 3, 
tha scores of one level are in each case Somewhat Higher than the other. This 
Topresents the increasing difficulty of tho PRI through the levels, from red through 
green and bluo,.to orange. | | j 


The Pi} -rosults are prosented in an alternate manner in Tables 4 through 15. 
Euch table presents the results for ong grade lave and one PRI level. for each of - 
the four skill areas and the total score, each table lists the avorage number of 
ob joctives feceiving instructional emphasis (heavy or moderate) from the Ob jective 
ranking; tho number and percent of objectives mastered Sy each student, om tho average, 
Gn the pretest and posttest; the averago gain; the maximum possible gain (difference 
botwaun thg total number of objectives and the protest score); and the percont of 
maximum podsibla gain (the actual gain divided by the maximum possible goin).e Suds 
a cColculation assumes that a student who failed to achieve mastery on tho posttest 
did fot master the objective on the protest. 


9 , c 14 
2 oe . 


It is interesting to nota that the percent of maximum possible gain achieved - 
for the total test decreases Steadily as one moves Prom grade 2 (67%) to grade a 
* (le 4). . 2 eh 4 ; ; 


Fagures 9 through 19 show the percent of mastery of emphasized objectives . 
" Fur Gach grace and PRI evel, broken down by objective. The Lower end of the 

bur graph represents the protest score, tho upper enc the posttest score, and 
the Lungth of the bar the odin, Ln thoco cases Where the pre score is Higher than 
‘thu post score, it is Indicated by a downward pointing arrow noxt to tha bor. Tho v 
ubjectivas which received a heavy amphosis rating are shown in black, those which 
rucoived a moderate emphasis rating are shown in narrow stripe, and thosa Tecatuing 
a light emphasis are shown in wide Stripos. For each grade level aa’ well as the to tal 
state scorns, there wero not more than ono or two percentage points difforence in -— 
thu gota scores, when comparing ob jactivas with a heayy amphasis, those with a: my 
mOderatu umphasis, and those with oa light emphasis, - , 


‘ippeadix G prosents+a series of matricios, one for each grade and PAL lovol, 
v™ which plot the percentage of Students mastering cach objective (in 20% increments ) 


1Guinst the degree of instructional emphasis. of the. objective (heavy, moderate and 
- ligt)» dll objectives are catagorized by skill level: Ws word attacks l= landuaqe; 
/ V= wocabulary; and'C= comprehension. ;Each cell hence shows how many objectives 
of each skill catedory with the indicated emphasis were mastered by the indicated 
" percentage of students. For example, on the first matrix (2 Red), the upper left 


cell shows "Lsl, Cs2", indicating that one language ob jective with-a haf’vy/ emphasis 
Was mastered by between 0 and 20% of tha students, whale 2 comprehension objectives 
with a heavy emphasis wore mastered by 20% of the studentse At the bottom of seach 
' matrix, the totals indicate tha percent. \of emphasized objectives for th given grade 
and PR] level, by skill category, which Were mastered by varying percepts of a 
- Students. These matricies can’ be useful\in calling attention to thos. ob jactives 
“nich nacd, the greatest amount. oF attentilon, which are represented by the cells 
in the upper left portion of the matrix (heavy emphasis, low degree of mastery), 
Thu celds in the Lower right reprosent ‘ob lectives which require little attention 
* (light anphasis, high degree of mastery9. | Tho cells in tho upper right indicate 
Neavy unphasis and high degree of mastory,\whilo those in the lower left indicate 
light umphasis and lew dagree of maetory. 


The most significant trend to be found \in an analysis of those matricies-is 
that cemprehensian objectives consistently are mastered by fewor- numbers Of Students 
than objectives in the other three sicill areas, at all grade levels and all degrees 
Of instructional emphasis. i 


For those readérs who have an interest ‘in a more detailed analysis of the 

PHI cesults, Appendix H provides a series of scatter plots for each grade and 

Pil Lowel, and.for each of the Four skill areas. Each plot gives a visual 
presantation for each objective, showing hew the pretest and posttest lovols of 
maste@ry comparoe A point, with the accompanying objective number, is placed at the 
-intorsection of the pretest score and posttest scores. for example, on the scatter - 
plot for 2 Red = Word Attack, objective 3 shows a pretest percent of mastery of ‘ 
287 and a posttest of 75%. * 


The following will help guide the reader in his interpretation: 


k, he farther above the diagonal yline that atpoint is located, tha 
greater the percentage of Student mastery ‘on the posttest compared to 
tho protest. : : 


a) 
ae 


2 The Farther to the right thet a point #8" Located, the greater ; 
' the percentage of student mastery on the pretest. Therefore, the 


potential for gain fron pretest to posttest is smaller. 


- ge=’ The farther to the left that a point is located, the’ lower. the 
porcentoge of student maatory on the pretest, Terefore, the 
potontinl for qain fron pretest to posttest is greater. 

4. "any point on thu line vhows no gain from pretest to posttost. 


to postteste od 7 ; 
*b ™ < 


J*® ‘Hhy point below the diagonal line indicates a loso from pretast 


S15 


sorgtrol factor Anal s 
| Figura £0 and Table 16 present the average percent of emphasized ob jactives 

mastezed anche pretest and posttest by grade level. Soth the figura and table 

show a direct decrease in gain scores from Lower grade levels to highere Grade 

2 shows a Ghia of 45%, while grade 8 shows a gain of 9% 1t is interesting 

aaj noto that posttest scores also-decreasa fron ldwer ‘grades to higher grades, 


WEN the Sdight exception of grade 6, uhile prescores: génerally show an increasing "'* 


=rend fron lower to higher grade. It must be remembered, however, that the scores 
Ste derived Flom four different levels of the’ PRI, and generally older children 
foak 2 more difficult level of the test, - ® : 


Figura 21-prosonts.the average percept of maximum ‘pogsible gain, broken 
Clown by thes average amount of time per da ‘that students spend in a Title J 
rua diy prograne There seems to be little gifference in the percent of maximum 
pos title gain uchieved by students accordingsto the Length of time they spend in 
2 sepplomontal reading program. Children who were invalwed in suppLemental 
or dirsg pregrans from 36 to 45 minutes per day scored 6lightly higher (55%) than 
Children who were in the program Prom 26 to 35 minutes (49%) or children who were 
in from 15 to 25 minutes (49%).- Children who were’ in supplemental reading 46 or 
m0ré minaites tended to score lowest of all groups (44%), although this group 
BveTage Tepredints only 59 children. The grade, distribution in each of these 
tind gtoups Ware relatively aqual, so that the grade level factor should not be 
infduencing these results. - : 

Px ; 

"A third eomparison was made of the average’ percent of maximum possible gain 
agains t per pupil Title 1 expenditures for the various projects. Again there seamed 
to bo telatiyaly little influence by the amount of money a project spent per pupil, 
a9 Zllustra ted by Figure 22. Fhosa projects spending between $200 and 9300 per . 
pupsl ahewed a S% increase in maximum possible gain scores over those pro jects 
Sperding leass- than 3100 per pupil, and scored L% Less: than pro jacts spending . 
between 5100 and §200. Those projects spending over 3300 _. per student actually 
etortd 9. Lowar than those prajects spending less than $Loo. 

A fartin somparison was also projected, comparing the gain scores against 
viribuS typos of praject designse Howover, the evaluator was unable to perform 
tne corparisea sinco the number of projacts whose design did not include a remedial 
type reading teacher wes so small as to make comparisons neaging less . 
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‘support a central tennet of tha. Title’I arene that the gap in basic skills i 


rou, Comparison 


References G 


—. _ es 4 

4 group of six Vermont schools’which  doré not involved in Title } reading 
programs ware Selucted ut the begLhn#nag of tho 1974675 school y@ar to be referonce 
schools. Jhasa Gix schools, with approximately 500 students total, were invdted 
tu paurticiputa and tho PRI was administered to. dtudents, pra and post, at the sumo 
Lime as it was guminiutorod to the Title ‘l atudonte. The intent was to pyovida 
a ruferoncy group of Gtudonta against which tho gadné on the PAL af Titly@ I children 
could ba compared. .An oxhaustive attempt was mado to match reference a d Title I 
schools, -using the control factors of typo of regular reading program ysed, amount 


_of time students normally spend in regular reading programs, size of §chool and *’ 


Community, amd type of community. ‘It was ‘then intended to match dpdividual students 
From matched Glassrooms on the, basis of* both total PRI prescores in the subscores 
Prom the skill areas, 7 ae 


several Factors made theymatching process very difficult: 


1.  2one reference schools used reading programs not commbnly used in 
other Vermont sthools, ee . y Doe 

2- Reference schools tended to,use higher levels” of the PRI than Title I 
schools. a ay ‘ 


5 3e Reference children tended to score higher on the pratest than: Title I 
"childrens . ; = es 
4. In some ingtances matched referonce schools and Title | schools tested 
different grade levels. aol Me - ; NX 
= ob 


\% : oe 
Arter sttompting numerous matches, the evaluator was only sble to produco Wl. 
mutchud pairs uf students who met the above listed criteria, This number of matched 
Puirs 1s obviously too small to draw any conclusions. It is interesting to note, 
nowaver, that in 10 of the 11 matched pairs, the Title--I student showed a greater 
guin From pretest to posttests, and the averaga gain in objectives mastered for 
Title I children was 9, compared to. the average\ gain of 1 for reference students. 


4 more gross comparison of reference and Title I children wee made, 
pre and post percentage scores for each grade level between’ the twa groups. 
23 shows a comparison of pre and post scores for Title I children, by gradg 
compured to tha group of reference chiléren judged by their teachers to be "| oreoa 
readers. Tha lower end of each bar on the graph represents the Title I group scor, 
while the top represents the reference “average” reader: group score. For example, 
tne grade 2 pretest bar shows a Title I group score of 33 and a tePerence group 
score of 67+ : 


The most interesting trend apparent from this figure and anal ais. is the 
comparison of ‘the gap between Title 1 and reference students from pretest to post=..: 
taut. .At vach grade level, except grade 3, the gap between the two groups had we 
décreaseod From prateasting to popsttesting, indicating that Title J students Over the 
year have gained in reading ability, as measured by the PRI, relative to this group 
of average readars. Except-at the grade 2 leysl, ‘the tost scores are not extreme 
Cnough to create a "peak offect"s At grade 7,/the Title I students actually scored 
highur on the posttest than did the referenc groupe This comparison tends to 


betweon deficient students and average students be decreased. 


ae 


x 
In an offort to provide O guide for toachers in-terms of which PRI items aro’ 
of greatest importance to the ability to reads an item analysis was completed on the 


Pri Item Analysis 


PRI, comparing those roference students who wa judged by their teacher to be above. 
average readers with those reforence Students Judged to bo below average readors. 


Table 17 lists the results of this item analysis. 
iv 


ey 


koe 


The first comparison lists thpse objectives mastered by at least 67% of the 
‘ good readers, but less than 33% of the poor reuders. -ThéSe are ‘objectives which 
tund to diffarontiate most betwoon good roaddare and poor passe. and, hence, would 
soun to bo of groater importance to the ability to read than other objectives. 
As shown by the totals, comprohension ob juchivey moot often appear in this group 
on u percentage basis, while word attack objectives appear least often. 


The second. comparison was to' determine which objectives were maStered by at 
leust 67% of both good .nd poor reader groups. These are the objectives which 
: tend to differentiate least between good and ‘pogr readers. A look at the totals - 
"shows that vocabulary objectives, on a percentage basis, mast often are in this 
group, with word attack and language next. Coaprehension objectives occur least 
in this group. : 


— : es | 
The last comparison made was of those abjectives which were mastered by less 
than 33, of the ‘good readers. These tend ta ba items.that a person need not have 
mastered in order to read well. Comprehension objectives were. the only ones found 
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Table 1 


NUMBERS OF .MATCHED CASES 
* AND THEER PERCENTAGES OF THE 
_PRETEST POPULATION, BY - 
GRADE LEVEL AND PRI TEST LEVEL 


3 Number Taking 
} Beth Pre and 
_Posttests 


438 
266 


291 


Number Takirig- 
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Percentage | . 
Match oo. 
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INSTRUCTEONAL EMPHASIS PLACED 
oO ON PRI OBJECTIVES . . 7 
Number Number 
Number of — _ Racdiving Receiving 
Ob jfectivaa’ T= ; Moderate 
asurer fph2sis “- Emphasis 
34 1? 14 
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34 19 dL 
41 * 18 1? 
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42 17 15 
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AVERAGE PERCENT OF EMPHASIZED OBJECTIONS MASTERED ON 
PRETEST AND POSTTEST, ‘AND GROWTH, BY SKILL AREA. 
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=. % Figura 2 : 2 
AVERAGE ‘PERCENT OF EMPHASIZEQ QBJECTIVES MASTEREO 
ON PRETEST AND POSTTEST, AND -GAIN, BY SKILL AREA 
f Grade 2 
FRI Rad Level . 
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Figure 6 


_ AVERAGE PERCENT OF EMPHASIZED OBJECTIVES MASTERED 
ON PRETEST AND POSTTEST, AND GAIN, ‘BY SKILL AREA 
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* The PRI objectives vary in the importance ef their contribution to the 
reading process. The item analysis of Table 17 points out some objectives 
which seem -to different@te more between good readers and poor readers, 
and those objectives which tend to differentiate less. 7 
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for each grade, with 1974-1975 evaluation information and a 1975-1976 
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This. section t5 for i an general information about the testing 


peogeay fe: this erade,. 


"pat 


Pa) 


. ; a 

4. 

"Heavy = “objs. 
. Moderate = —__objs. 
Light/None = ____objs. 
TOTAL = ob js. 


none. For this 


Number ‘of students in this grade who were 
both pretested (in the fall) and p sttested 
(in the spring) with the Prescriptive : 
Reading Inventory (PRI). To determine this, 
see computer output of test results for this. 


-prade and this test level. 


® 


Level of the PRI administered to this_ 
gradé (Red, Grden, Blue, or Orange). ~ 


Number of objectives tested by the test 
level used for this grade. To determine 
this, see computer output of test results 
for thig grade and this test evel " 


In Fall 1974, each union indicated the 
instructional emphasis to be given each 
objective tested by the PRI for this grade. 
The degrée of emphasis was determined on a 
scale of "1" to "5" with "1" indicating the 
greatest emphasis. The "5" point scale 


‘has been converted to a "3" point scale with 
Pp 


(1) heavy, (2) modefate, or (3) light or 
rade, indicate the. number 
of objectives in each of these three cate- 
gories as submitted in the fall; The sum 
for the three categories should qual the 
number of objectives tested by this level 
of Ene PRI. - oF 


SECTION II 


last fall will also be recorded. 


The numbers of the PRI objectives are listed on the hext few Pages under 
four categories: Word Attack Skills, Language Skills, Vocabulary, and 

Comprehension. Record information only for those objectives tested b' 
the level administered to this grade. SO i 


Pretest information should be 
recorded only for thoge who 
both pre- and posttested, The 
computer output from fall 
testing is NOT to be used. 
Use the computer data most 
recently supplied. 


Complete columns B, C, D, and E in the table below, using-the following 

descriptions as a guide: a ae 

A. The level at which the objective is tested, R= Red, G = Green, 
B= Blue,, 0 = Orange . 


B. The number (N) and percentage (%) of students who mastered the 
objective on the pretest. Obtain from recently supplied pretest 
computer Output. - 


Cc. . The number and percentage of students who mastered the objective 


on the posttest. Obtain from posttest computer output. 


D. ~The gain in number of students mastering and the percentage of student * | 


mastery fram pretest to posttest. 


& 


Example: Completed columns B, C, and’ D for 50 students. 
B C D 
N % N % N % 


10.20. 40 80 40 60 


= 


E. Degree of instructional emphasis assigned to each objettive in 


Fall 1974. H = Heavy, M =.Moderate, L * Light or None. 
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Loves | Mastery 
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SECTION rag 7 ~ LO ee 


This section ig ‘fpr: “Sbpbilins the gotal ember: of objaani Gas: that ‘received 


either "heavy" or Smodardte" instructional emphasis, the qvétdge numbe 
and percenkage of objectives mastered on the pretest, ‘thé average number 
and percénte @ of objectives mastered on the posttest, and indices of ¥ 
growth from/ pretest to posttest reflected, by (a) the average gain per 
Student in Aliectives Mastered, and (b) the’ Perrenises of maximum growth 
this gain dn, objectives mas tary represents. “ 


The diagnostic purpose of criterlon~referenced, tests allows for more 


flexible tlasaroom management and can eventually lead to a truly individ- 
ualized dmatructional program. A criterion-referenced test does not 
have national norms or controlled administration, and so is rarely used ? 


' for comparison of students’ scores, ,However, if an evaluation study ts 


id 


to be conducted for a project in which criterion-referenced tests have 
been used, some kind of analysis of, scores is inevitable. One might, 
for example, compare the percentage of students who mastered an objective 
on .the pretest with the percentage who mastered it on the' posttest. Yet 
a question remains as to the interpretation of such comparisons.. . © 


‘ 


. ff 


It is depoecaeie to guard against misinterpreting the information reported 


in this section. It is relatively safe to assume a rather high correla~ 
tion between the number of objectives mastered and a student's «competence 
in reading. However, because research is not prebently available in this 
area, caution is advised: "A statement such as, "an average of 10 of 35 
reading objectives were mastered," implies that each of the 10 mastered 
objectives is equally important in the process of becoming a good reader. « 
This probably is not the case. In the set of 35 objectives referred to 
in the statement above, 10 might he considered vital to reading achieve- 
ment and 10 others considered very important. Perhaps none of the 10 
referred to fn the statement "10 of 35" was one of these important 20. 


, 


' he information requested in this section cannot be directly obtained 


from the computer output. The computer report contains the percentage 
of students who. mastered an objective; in this ‘section, the average 
number of objectives mastered by each student will be computed. 


Below. is a éampie completed table and instructions for determining the 
eight figures required by the headings A’ through H. Read the instructions,’ 
study the procedures, compute the figures for this grade, and place the 
information in the table that immediately follows the instructions; An 
optional worksheet to facilitate this task and to ensure the accuracy of 
your figures is given-at the end of this section. 


wh 


Tatal. “,* Average Average Average Maximum Per 
Nutiber : Number of OF -% of Ob- Number Possible of -\ 
(Of Objec- Objectives jectives of Ob- jectives of Mas- Gain ‘in . Maximum | 
tives ‘That :Mastered Mastered jectives Mastered tered Ob- Nuwher of ° Possible 
Received on Pretest on Pretest. Mastered on Post- /Objectives Gain- 
Tns truce : - on Post- test ' Mastered 
, ‘from Pre~ 
teat to 
_Posttest 


‘tienal - : - eo test 
Ewphasis 


‘The data in the sample table are for 10 emphasized objectives wie the 
following percentages of student mastery (obtained from computer output). 
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Objective ' % Pre ; 4 Post yy - 
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A Total Number of Objectives That Received Instructional Emphasis 

. This can be obtained from Section I, number 4. Add the numbers of 

a objectives in the "heavy" and "moderate" categories and place the 
* sum in Column A. — 


In’ the example: 10 objectives received heavy or moderate emphasis. 


“B Average Number of Objectives Mastered on Pretest 
The computer output lists the percentage of students who maatered . 
each objective. To find the average number of objectives mastered -- 
by each student, change each per cent to a decimal (e.g., 47% becomes 
-47; 9% becomes .09), and then add all the decimals. Placdé the eum 
in Colum B. 4 : = 


In ioc sh 17+ 6294 .304...417 2 28 


; 


D- 


or 


OO OS ete: reported to “receive: emphasis. 2.8 + . 10 x 100 = 28%) 


sum’ An Column De 


, difference dn Column. F. er 
.In the example: 4.9 28 = 21 : 
23 f 


' Average Numb er of Mas beted Oi 


"by: Column A (ce nEbee, oe ehiaer t 
emphasis) ; and then eevee in 
in Column C. : 


state 
i “that rece veo, ndsuae ¢ 
dentsby Ado: Vek 


“In the example:., 4, group averaged 2. 8. oa othe pretest 


“and, 10. Ob sacbs ga 


Poatéest - 


Cnadeags Nuabee of vOb NG ves Mastered | ont 


Follow instructions fox Column B, 


In the example: , .40 ‘50+ AO. as 50.= hs 9° 
x 7% 

Average Per Gent of ‘Objectives Mastered on. Posttcsr 

_Follow instructions for Column C uate posttest’ data. 


product, in Column E. 


In the e txample: 4.9 + 10 X 400 = 49% 
YS a 


Subtract the sum in Column B f: 


ears in Colum. De Pla 


we ; oe 


Maséd mua Be cibis Gain ia Nunber oe Objectives Mast sedate: sirom Protest ms 


_to Posttes fe ar 
. Sabtract pet sum in ‘Column B bon the’ sum “ Column A, place’ the an a: 


difference in Column G cae ; tw ot 
In the example: 10 - 2.8 = 2 2: Vt ae br oe vp ae 
7. 2 is ‘the maximum number of' objectives’ that., “ean be gained’ since eel at 
2. 8 of" the 10 were alteady mastered at. | pretest, 


‘Per Cent of Maximum Possible ‘Gain i) rc - 
Divide Colutin F (averafe number of objectives ‘gainéd Since pretest) | 
‘by Column G (maximum possible gain), and then multiply* the: quotient. 


by 100. Place the, ri oduct dn Column H. 


“3 


In the “example: 2.1: 7.2'X 100°= 29.2% 


_ Therefore, the gain. reported fein: pretest to pos ttest. (2. 1 objectives) , 


was 29, 2 of the’ possible gain A762 objectives). _ pe 


oon 


Me ‘using ‘the computer output that ‘shows, Pr 
objectives. : Lote ae 


otal’: - ‘Average © “Average os dAver * 
Number.. Number of %-of Ob- — Number i ‘of. Ob- 
of Objec- Objectives jectives - of. Qb- _.. Jectives:. 
tives That Mastered Mastered ° ject‘ives ° Mastered | 
Received ‘6h Pretest. on Pretest Mastered on. Posty. 
Instruc~ . Ree Ms So * Me - aR ‘Post= ; 
tional Oe eg Pg le eg ® eee 
Hmphasis. - 


‘Mastered; 
, from Pretest, 
td. Pos ttest | a me 


aa a ee : 
* . 5) . fi 
& a es : or 7 
Mn a e i 
Ae era : 
ae ae ae 
Ls ake a. 4 
% ay a es : : a 
" ee a ; 
oe Ho ad 
re yen fe » é 
: i ¥ ww 
Bib og . 2 
\ 
‘ 1 
a oF : 1 : 
. Ns 
. . Pal 
i 
: a 
“ ry : 
‘ eaeers 4 
‘ ‘al & 
4 é 1 o ; 
i 
‘ A ra 
* ia ” 


os F 
bs et 
2g 
‘ . ca 
. og 
; G 
Sow 
# - * 
~ g _ 
a 
a 
4 
4 ra . . = * a so 


ERIC: a. oe 4 


Qin 


Recded the 7 


‘numbers of .the 


objectives: that 


Total ‘number 
of objectives 


Fy 
_ # - 


Placg this fig~ 


“ure in. Column 
A. ‘of the peeeee 


fag. Tevetved, heavy 4)" 


my 


* student: ma tery. 


"WORKSHEET: 


Record the =. 
‘decimal equiva-. 
‘lents of ths 
pretest ‘ 
) gentage: 


for each... 


Sum of decimals | 
ae eee 
Place this figure, 
in. Cokumn B of 
the table. 


Colum B by: the 


100: 


| Place. this. figure . 


“Record” the. ; 
‘ decimal equiv- 
"“alents of the. .“ 
‘posttest ‘per- .- 
centage’of... |. 
‘Tatudent mas- | |, 
| tery’ for each 
_ objective: _ 


number in Colum A, 
and multiply by: 


in Column C of: . 
table. . "| ” 


| Sum.of decimals 
of . * me 5 . ‘i @ 
, ‘Place this figure 
in Column D of 
Pa 7's | the table. 


@ 


ERIC ; 


JA Fui'Toxt Provided by ERIC 


in Column A; and. 


figure in: 
- Column Eo: 
“of the tablet 


Divide the sum in | 
-Column D by. the number 


-Place this =  °: 


-Place’ this 
figure in 
Column F.- 


| of ‘the ‘tables 


*h. 
“ 
ca 
x 
hed 
4 * 
* 
‘a 
ut 
‘ 


"my rAd 
“e 
a) 
= » ; 


“86 
ei 


Subtrace. Colyan 
B from Coluim D, 


_ Place’ this *." 
‘Figure digit” 
Colin. G Be 
of - the t ie 


vik. 


‘Subtract Column, | 
B from Column A. | 


3 r 
i a 
~ ee % 
ae ee 
Ae. 


Divide Column. F by. 
gCoL unin, - and multi~ 


-. 8 


’ 


|, Wray v 
‘of ‘the table. yi" 


oe 


. «a 
t 
a. 
| 
4 a 
4 
: a 
¥ : 
" 
’ 
‘ 
3) 
4 i 
4 4 
i 
on 
‘ . 
ly 
¥ * 
"y . 4 
Bek = 
Oo. 
3 
# 
4 
Po 


~ 


, i 
, SECPION IV 


“or growtk 


4 


This section. is for record{¥ Percent 

‘the postteat for each emphahized ob 
‘displayed here can offer. reading ne 
group, of. students. 


ae 


ue 


tivea' in the upper left portion of 


with small. percentages of mastery | ° 
i heed exists for the 


roup a5 a ‘whol, 
ight portion of the: ‘figure refléct 
or light Setiucet baal emphasis: but 


(¥ = Vocabulary, W.= Wo 
sion) | into the appropr 


+ ge 
“F 


annie me 
: an to. 


21:40 


. Percantaga of Students Mastering Objective 4 
0-20 


ntage. of mastery . -on the pretest and... 
jective. The information. as it ia”. 
jeds agsessment ° information for this. : 
F u ; “ . 3 . 


sé 


* *AB6 uine. that He degree: of instructs venti pta 48° synonymous with che 
| importance of ‘mastering: the sig 


at this gradé level. “Those objec- 


' 


the figure (heavy and moderate emphasia | 


r growth) are those: for'which most 
e. Those objectives in’ the ‘Lower. 
leagt need. 
show. a targe. a i of mastery: 


rd-Attack Skills,’ Ls Langilage Skills, 
iate cell on the following, page. . 


“Objective 3 ig a Word Attack Skill ‘that received hedvy : 
..... dnstructional emphasis; 23% of ‘the students mastered ‘ fon et 
oe, ENE pretest and 49% mastered. on the posttest. © 
» ‘ is” a Comprehension objective that received light instruc- 
“ tional emphasis;, 50% of the students mastered on the ‘pretest. 
and 78% mastered on the posttest. —— 


Objective 62 


ae rat 


41-60, 61-80 


ts 
Ls 
@ 
. Degree:et TistroStonal ci 
“Emphasis * ¥ *- 


* S ee od 
My" . 
a) . 
Pa 
. 
; POSTTEST : Qs a - 
ar sd Percentage of Students Mastering Objective | : 
: 020 210 41h 61.80 #1100 
HEAVY 
5 
G ad 
By Ree 
& & | MODERATE a 
Ba 7 
| # a _- 
Bs : 
u . . 
6. LIGHT \ 
or \ 62 
NONE \ 7 7 t 


These recet' Yed moderate 


ber ‘of’ ache jae sted at. thie level ‘end “Mig curricular 


a - d ee 


-PRETEST > Senn? ae ae 


Percentage of Students Mastering Objective. 
«41-600. 61-80 


ut 


Degree of Instructional 


MODERATE 


4 


Emphasis : 


ad 


( , : . ; i : By 
: ct a : . 
ae. . ge 2 re | 
; ze ; ” : " : te ale 2 = i 
POSTTEST: — - A, ek one , ae, She 


Percentage of Students Mastering Objective® 
0-200 ° * 2440+ 41-60, 61-80 :,. 


" Degree of Instructiotal © 


am. F aa 
1 

‘ : : . : 

4 a # % 

as 88. Dee 

2 ; Ses . 
2 : : ’ 
. ; ’ e ; 1g. 7 * 
. © ~ + 4 aa . ot = a c 
i * tore 


ERIC 


4 “we. Ld i are aa ae _ eee ae 
of . ; . , ; 
et ‘Appendix I 


; La (optional) 


: i+ 
Tee ; 


‘Wecauke: a eetceutemece. uo stest- t-'predentg | ai'ffergne Jetads oF ake’ : 
than a norm-referénced test, cafmunicat fon fof: test,.”. ‘results to: ‘teachers’, .. , 


- purpose of' this Appendix ig fo Facllitadte studying and’ per eae ‘f 
“the teat results by giving-a. Visual pepe CrMGee en of .the. So le . 


= t 


parents, and boards of education becomes- a. ‘justifiable concern, The 


PepOEtee in Section II. 


te é 


pretést and pogttest percentages of mastery for each’ objective’ in each . 
of the four curricular, categories. Obtain the pércentages: for each 


objective: from’ ‘Columns B and C‘in Section II. Place a dot: oat the: point: ; 


This appandic provides four ee (see Page. W- -20) for eaten: ie Be 


of intersection and. record the objective number beside the-dot.: TE more. “e 
“than one objective , falls at the sdnie ‘point, piace both‘nunbere beside . 


be 


the dot dnd “Separate | them by a‘coma. ~ Paes. 


Examp1é _ For Ob4ective I, the’ Praagee per’ ‘Macthdbeery + was 20%. a. 
.’ and the posttest per céweymastery, fag. 554, The percent~' | 
ages “for pbicctive 2-were’5% and 23%, respectively. ne 


oa CURRICULAR AREA |. Veo 


= ™ ‘ 
. a & é 
= aor s 1 ‘5 *F 
wae « a ee ae a. * 
’ 7 : a 
. ow . * 2 
: ; eit : ’ 
‘ ? ay * 
4 : 2h 


> Posttest Per Cent Mastery =" i a . 


be 
: i ; 
, , 

Ua tal 

ho tas vii) nt 

HK es 

‘ 

a S Oh : . “Bee 

TaN Dake : aH 


Ve 


+: 
TER Se 
bee oy 
iy oa 
Sapo BS 
. : 
4 
a 
4 
> Oo 5 10°.15° 20 25 3h 36 40 45: 5055 60. 65.70 75 80. 85 90 95 100- 
1, Cos ae Le Pretest Per Cent Master~o 0 a ae 
. : re a t Bs : Tape ing ecee F “le . z al si 
', x ear 2 Safe: oe “e ace z a iy ap 4S 89 eee: & - — "eet i . 


ER 


~~ “tae” the folloving. asa guide to _ ncerpreting the: gx , 
we 


vale y r above. the diagonal line” that & point ; 7 
arene agente: the ‘percentage of student mastery: on, the; 


; 2% ‘ee oy 


sther, to, io righ; that a poddie is located} ‘shi 
tHige te ena, On ‘the pretest. ‘Ther Fo: ox 
ain i gia ig from. pretest to Roehren: 


a a ne mene 


ee 


“ pe 


re dntage” of ‘atudent- mastery" on. the pretest. T ‘lerefore, f 
, potent3al for" gain. from pretest to posttest is, gi edter. 


a tt 
e, 3 


ade Any potat below ‘the’ ‘diagonal, ‘tne indicates. a joss from pret chy . em 
rat te posttest. * - . 


oer ¥ ‘e. . af 
= u fe ey ee P . 


int on the line shows no gain from pretest ¢o posttest. 


3 ‘ 
‘ 3 
2 ‘ 
" 
‘ 
: 8, 
é . 
¥ . & 
, 
i 
. 
a . . 
“ ‘ . 
8 
‘ a, ’ - 
. 
. 
& ‘ 
‘ : 
' A, the Yt e 
» “y 
‘ a ‘ 
rar 
4 * 
om 
eae ia es 
“te és 
‘ wat Jos 
: 2 , 
‘ ¥ = s 
» 
ae 
{ ‘4 
es 
: - 
& 
; 
= a 
* : 
1 i 
' 
4 
O. 
‘ « a 
© = i 0 * 7 a 
4 e = < 7 - a 
a % = “ee 2 : : 
rf + a 
. ‘ = ee: fs 4 
2 . ‘i : ¥ i . fa 
e y te 5 * a * 
a e 3 eo & (ae a x 
f a a s = s * 
» pene rt ane rf * 
= A ‘ ep ee a ) 3 
f gt a , ane 3a “ é : 
. b's : : Ct 4 “ zt « 
* 4 oe ‘ - : - . . 
: ia . = = ae = 
n ae Exe Ho, 7 “ 
‘a =, = - i & 
a 3 . 2 " ' 
2 ’ 
* z 5 e 7 : # 5 . ‘ ' pe 
s 2 . a s 
& a # a fF 90 5 
j rs fe aes zee o* ‘ a 
‘A : 
‘ * * 
‘ A 


ne a ee 2 Mp6 ee aa ee ee 
‘<) : a * ee. a a 7 “3° . “ag : 7) ° * aN fi 


[A uit Text Provided by ERIC 


1 | i 
j q ] | I = 
| | } 


EA 


“CURRIGULA 


- = 
Bi 
. fy | 
i [ 
« | q | 
-{ ] 


Sans 


R AR 


2&2 8 SRLS 


Aiaisew U9 Ba 


o 


sa1is0g 


75° 80 85. 90 


15 20 


10 


“5, Pretest Par CénéMaster 


25:.30.35 40 45,50 55 60 65 70 


y 


t 


4, 


Ee 


Q 


[ 


| CURRICULAR AREA - 


2 oD .9° OC HW SO bw eg 2 o b . 


. es Arsysey yua9 Jag sasog . 


“5 10 15% -20..25 30.35 40 45 50 55 60 65 70°75 80 85 -90. 95 100 


‘ 


“Pretest Per Cent Mastery 


al) 
t “ei 
ar? : 2 ae 
: coe art , 
awe tier 
. 


ay : 
i= 7 


| 


r 
| | 
q 
‘ { 
i a ee oe 4 Es 
FA e 4 aad oe 
% ist) 1 
: % a J | 
| al L 3 | “| mz : 
; iy a : | 4 : } : | : | 
+ 7 ‘ q q q ] : ; | | | 
aes - 2 a it * eS ad | [ | 
| | : ‘ i i j 


“wy 


‘ay 


. Pretest Per Cent Mastery a 
:*y ‘ a? . - 
93 


bd 


Xp: "2B, 
& 


5 10 15 20 25:30 35 40 #5 50 55 60 65 70 75480 B85 90: 95 100 te 


a: 
I Pe 
2 O. Be a o ~~ eS 3 [Te] 3 = 4s Pe a i. 3 0 er 


>. oes, a Araysew 1099 Jaq isaysog ; 


“CURRICULAR AREA _- agmliee! ot 


* prggt., Eee : 
ae UMP a ° 


ULAR AREA’ __ 


io 


‘URRIC 


= 
222 
S 
i | 
j 

a] 


L, 
= 


& 


90° 95 100: 


60 65 70 75 80 85 


0; 5.10 15 20 25 30 35 40 45°. 50 55 


| SPretest Per Gent Mastery” 


tel eae a 


ee. hn IN ona =e 


- Wa’ real as. sata as that. thors’ oe anu” vital dice “th this’ sige Wain ; 
) bo used to inf.luanco tho deciadon: making ‘process in Title I administration, : 
J also improve the taaching pratgs sin. thb litle, I projécts. Howavers 4S i nee ; 
adar draws inferences ‘and conclusions « “égon "tha data ang. discussions .\.20°°. PED Boy, 
thie ropart, wo would. Like ‘to offer: w cautions, wich ‘ehguld bowconedderad. > 
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l.. Tho PAI, budng” a ‘oritotionprofurancad tant, Wet oss oni | primary. 

no an aid to Smpraving™ ‘Anotruction in tha plyserpomy and not oa an 3.3, 
— avoluatién indtfumonte Although we as avaldatorb see no conflict * 

in using a criterionereforenced toot for. Poth: purposes, tha reador 


should bo aware that this was not tha usd intonded by the test CaS SQNBERs 


"2. Many ‘boasosioene “patweon mastary of oelaue groups of ob jactivas implias 
that “each. ob Joctive is of aqual importance -to thd reading process, and 
vo that reading: increases in direct proportion to;the number. of ob joctives 
. ' mastered. “It is: also implied that,-each ob jective’ is*equally difficult 
- to master. Wa do not at-prosent hava sufficient data to assess the, 
dagrae ta which these points. may be. truge a va 


3... Any test “tonds to bocome -less accurate as a Student's 
«gi thah. the upper or lower limits. Et -is conversely ma 
+ its miterango scores. Wd would urge. cdution in- making 
foe invetving scores which are at either REAM ag 
ty i : 
4. "A large number of the obJectivgs measured by the orange davai ae tha, ‘°° 
PRI (grades. Gy7,0),are beyond ‘tha reading leval of Title I studants.-" a 
| This may havd"accounted partially For: the Lowa scores, on. Orange Level ¢ 3... 
_ testing. and students nee eve Showed grontor ger - 8 } dau Parisian 
_ tost, hud ‘ican usdde ; as * wf 
= 4 oe 
ee ‘Conveteely, when a lovel. oF the PRL wars ; ‘used witch was ‘too. easy For eS oe 
a student). then: ager -tendad tobe ‘g0 high, as to-allowlittle 
room: for growths 
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Gs The dessus ofring tructional aichesia as. repraéanted by’ the Stakowildil 
ie is. not fibeoscatity synonymous with the impprtancé ° of. the ..' 
* Objective in Loarning to-réad; although this should have little orredt . 
on this eagle’ as” there was oy Aittle difference An. tho. 


“Thane” ‘ara. ‘a: umber oF ponktuctone whieh sdem n appropriate: as, a. . result, 
this “ot oe data, a : - walt 
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Seve, BLowkhig the: porcont 
i: ts digh. ai et gradg 2 toa . 
i Ge cavade Be ficuras lee a ‘graph ‘gain, scores of 25 to 40 
 porcantugo points at the lower grade lovals and 8 to 10 pointe at grado | 
* B+ Figure 23° shows a reduotion in tho gap .from pre to post teating © 
-hetwadn. Title I students. ang refardnco group average readers. This gap... *, 
was. rodugad from 34% to 15% at-grado 2.and from 40 to 8% at grade By le ik 
Ate poate rieta I ‘studanta ectually, Scored Aare an pear teer si than 3 Pte 
tha" “avatgha réadors. : pe or 
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* Title ee in the Lower praded have shown greater seauttis: on. the. 
43 average, than Students at the higher grades... This growth: 4s greater. at 
.@ach Successivaly ‘lower, ,grade levdl. | This conclusiin ‘ is supported by ‘the i 
statistics summarized undas the previous conclusiorn.and particularly | &. ¢ « & 
Figure 20 and Table 1é, Showing: a gain of 45% at grade 4 decreasing as 
steadily to 9% at grade 8. Although. the ob jectives at the lowar levels Pees 
‘ may be, more‘ specific and mate, aasily masteredy the differdncas : ‘in, growth 
‘recordedare Pign tiene anoitgh to warrent this. conclusion. 
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rated us Bvinig heavy instructional emphasis by: teachers; ‘than, for Aight “ee 8 
: emphasis obectives. Figures 9 =~ 19: show: the recorded gain’ For each* grade ,.:% - 


‘Level and forthe total group did not vany. by more than a bige petapntage”: : Faye 
 “pognts “neon Heavy. to mk enphesizad pidectiven: > | st gle 


a ‘Frioiigthe. soniyale, ae in: Figgze: 2, one can’ ‘find: :no support for. ‘the | a 
_ » Sneguntorfichat: a greater inuestmant ‘of money produces a. greater SFO co 
_ in-rddding ” skills, - Un the Gantrary, projects: Spending over $600 per Ludent: a 
‘tended'.to show Loss . growth anong: hoir ‘atudents. than; Pee Splnding, ‘less ' 7 
than 510b ‘per, pynil. a a 

ea 4 ae : “wr a wo . 
+ 8th eae ien nae the cid ter the length of ‘time that. ‘students spend. in 
the: supplemental. reading. program, the gregter the gain “will. be is also’ nat 
Supported, as showh by Figure is Students * ‘inyoby ad: 46 minutes or mord™ 
'. per day, showdd less a tha students invalvettings Y lesser samounts\ of time. 
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* From’ ‘the Previous: two edrelien any: it seems to Pali that polnaas. tha’ ‘single 
greatest factor influencing’ ‘children's. growth in reading, skill ds fhe. teachgr, 
dnd'-that her/his skill | and personality outwodgh all othor influences er, 
ds money spent and time involyade -s ne Ps aie SG 
see a 24 2 a e 
ae Gonprebensien ‘sbjectiven seem to be particularly’ important ta-a student! 8 
. ibility to read, .as shown by. the item ‘analysis of Table 17, the scatter fy 
plot of Appendix :H, and the matricies - of ‘ Appgndix Ge “tho recorded growth “;: 
“for ‘these comprohension ob jectives wag*las®, howaver,. than for objectives 
Sr ‘thg. other ‘three skill ALGIS y as shown, by the scatter plots and hattigioss 
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tho: rocommondations presonted a this soction ora based upon the Findings 
antad in this study and tho ovaluator's oxporiance in working with olomentary 
ol programs. They oro listed in no specific order, and are intonded os points 
iscussion for Titla I administrators and project otaff. 


bs pscuntdinu od of fort should be made to gathor information which would allow 
ducisions as to the relative affectiveness of various types of Title | 
programs. Such on offort should ba continued into the next yaar, and 
expanded to provida control situations ollowirig mora exact cofiparisons. 
Spacifically this might includo o referanco group selected as a match to 

a Title I group at the beginning of the yeare It might olso include tha « 9 

per den assignmant of: marginal etyudants into a Title I program to study 
the offect of tha program and teachox influenco, In addition, an expanded 
aftoar=tho-fact unalysis of tha 197374 data would help provida the data 
basa for a longitudinal study. 

” We would reconmend the cla yvolopment of national, or stata norma, ‘or both, 
ywhich would allow the PRI to satisfy those people who insist upon . 

, “stondareli.zad test rosults ‘as the only way, to measure the success of a 
project or student. Too many. districts now foal obligated to use both 
the PRI and a standardizad-tost, producing’a duplication of time, effort 

_ and cost. ae e 

* It-is +: depexatous that test. resntts bo returned to LEA's mora rapidly, 

praferrably within two to throa weeks. If teachers aro to affoectivoly 
usa results, thoy must get such infotmation carly enough in the year 
to be of value. The scoring process which’ now: takes ono to throe months 
is much too ah Rarhaps the logis tics: can ba improved or a now: contor 
Found: to do the Scoring. a no 


* Greater afforte should be made. to f. that test cosults and local 
analyéis reports. got into the hands of teachers and project directors uho 
can best use them to improve instruction. Interview results seen to 
indicate that such toachers often'do not soe tho reports. : ae 


* We foal the number of reports prepared, by tea: computer scoring service 
may be greater than necessary. Wa do “not boliaeve the duplication of 
reports by Vermont's four skill ner ang tho PRI's original saven pro= 
vides much additional information, ssibly a committoo of Title & 
teachers would be willing to maka rocennendatlons on angen reports aro 
‘most valuablo. 
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* vo foel the current method of comparing’ tho growth of all districts agains t 
those objectives given instructional emphasis by a state avaraging process, 
may do a disservice to the LEA'se It might be more appropriate to compare. 
tho growth of each district mye inet thoir: own sot af. euplinexcad: objectives. 

* we facl Title I projects should be Grieaukagad to provide arestor emphasis 

. in their instructional program to the. compreh ensian objectives, which seem ° 
to ba of greatest importance in difforentiating betwean good and poor ss pial 
and which soom to show ‘the least growth of the four, skill areas , 
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given a word with a single consonant 
and Several words which are idontical | 
except that they begin with a consonant 1 1 xX. X xX Xx x 
blend. (Consonant Substitution: 
Blengs ) | ; 


The student will employ consonant 
substitution in choosing from 
specified initial or finol conso- . 
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| a santence containing incorrect * ; ; 
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(contraction and contracted a 4 
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' phrase. (Contractions: word Pains ; . 
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words, by adding the correct affix 
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printad:answers or by identifying nonsense ‘12 . 2 xX ; X X -xX 
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definitions. (Like or unlike Entitisss = | 
Wo od befir uitions) See, Se: 


' 


‘Tha student will match like or unlike —_ 
entities by pairing words with their PL L 
‘ Synonyms « aia ‘or conn ee -_— : 
_Synon Wms i ge a a eae 
The student will. make like or unlike 

Sorte by. pairing words with their > 
‘antényms « ” (tke, or Unlike Entities: l L 


Pacer ‘ z F 


._ The ebadent will demonstrate ability to 


use context to complete sentances by, 
choosing ‘the only appropriate word Prom 

among several unrelated in meaning. 
AU8e- of contexts sentence Lompletion) echnical’ acl liming 


Tho: ee adent will make use of context in 
choosing the appropriate ‘homenym fram a : 
_ pair to complete an inconpLate sentsnca. 2 2 Xx" xX xX xX 
Homon) ms in, Context ) ene 7 *, : 
\ t. 
The’ student will make use of context to 
ee from words related ‘in meaning the 

» that wihd, ar eiebe a Sentence 


46. The student will make use of context to  : , 
select Fron among possibla words thd most | ° 
suitable. or precise word to conplete a xX XxX xX 2 121 

ian cello (Most. Peaciae Ward dine 4 a 

Lanter a : 


48. Tha atudent will employ | cor text, . > dem 
ie onstrats rcacognition of , oe mat ing by. 
/ . ddantifying the corract d findtion of a Xx 2 2 2-i 1 41 
word indicated ina sentenas. (Word 


— DefinitLon in Context. Baal cece oe. Bo 


49... The: student will define worda in Leola= a] 

td4an by matching certain wards with - 1x 
their dafinitions. - (Word |Dafinsts on 
An. isolation) Leceiaacancel a See Or eee ee eee 
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50. The student will eanley edntext to - a [ 
defing. multismeaning words hy comparing 
certain sentences containing such words 
with definitions, or by selecting 4 
*, sentence from a pair of santances con= a ‘ 
. tadning the word to match & given dafi~ | Xe. 2 2 2 2.2 2 
nitions ((Multiemeaning: oss and  * 
— et a itson | eee eee a eee ee | 
BL. _ The: Studien will daniaatiaen racogstion 
' of the telatton of multismeaning, words me 4 
to synonyms by selecting froma group of 
worda the synonym for a. multd«meaning 
word usa@d in a sentence. (Multieneaning - 
Words and Synonyms) ee 
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2. The student will shaw 
. Synonying by, selecting 


£82) 8 in word. (Ss non: 


53. The student will show 
‘ antonyms by selecting 


certain, word. (Antony 


54\ The student will show 


‘recégnition of 


the- synonym for a 


ms: Selegtion) 


recognition of 


the antonym for a” 
mS 8 Select) 7 


recognition of — 


homonyms by salecting the correct 
homonyms from a pair to complete a X 2 2°2 2 2 2 
“sentence, or by identifying the correct 
hamonym aa used in a sentence. (Homonym . e 
2 Pairs : ~Satection Seance 


COMPREHENSION . : i 


37s ~The, student will eaaieteoke recall of 
Saquanca of events in writtan material 
by indicating the specific part of-a 
story liq which’ an event or action oc- 
curred (age, "First part" oy “Last part"); 
by indi#ating when an event happaned 
im relation to other events; or by selecting 
the corract pial ctiod of 4, sarias..of 

vant ES ¢ Ap WED 
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___Words) "* 


60. 


_fecall by ‘iparts)) ae 
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OBJECTIVES 


The student will demonstrate recognition 


_ OF setting in reading matter by identi~ 
*'Fying the setting of a paragraph, a 

» story, or a part of u storys or by 

rial. questions about tho effect of 


The student will demonstrate recall of 
story detail by sglecting from among ~~ 
possible facts=<actions, places, names, | ; 


occurred in the story, or by completing 
- sentences: that, list part of the detail, 
"(Story Details Recall or Descriptive . 


‘descriptive words «= the one that eG 


.Thé’ student will pacall story details in 
naming the story or story part in which’ 
cartain eyents occurrdd. aay Details 


* Tha atident will recall story details in 
identifying, true statements about the 
story. ‘(story Details Identifying True 
jtate ents 
‘The student will demonstrate pucoahitice 
‘of cause and effect by identifying the 
‘Cause of a given effect in.a story, by 
matching: groups of causes ‘and effects, 
or by identifying the effect of a sae 
ause or Effect 


The. otudent will demonstrate perception 
of inference by identifying the correct 
inference that cah be drawn from. reading 
material or by answering question about 
the material that require anTerenane to 
_ba: raune. : (infarence) 2 . 
the student will demonstrate the ability 
to form conclusions from reading material 
by identifying or supplying the logical 
conclusion or.chooSing the best of 
- Several conclusions, or by answering 
questions that require conclusions to be 


——rawns (Conclusions- Formation) 
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The student will identify the clues in 

*feading material that lead to a 
conclusion....(Conclusion: factor . 
[dentification) OS Oe 


ne setting in a storys (Story Sette DAD dane 
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j68 THe. wtudeht will draw inferences in\. . q - : . ( 
anticipating or predicting future action 
- or avents. based upon the content of 
reading material.: (Predicting Future 


i7¢ Tha student will demonstrate recognition . \ : , 
of thu main idea of a passagh or etory - A 
by selocting the most appropriate title 
by choosing the g tay phrase, or g@n= a, * 
tence that tells ‘the m&in ideas, or b , os 
identifying the theme, moral (lesecn), | 
or best summary statement for a given 
Selections, (Main ideas Summary, Title, . 

meee =| ie Es |__|: FP ero 


58. The studerit will employ character 
‘analysis in identifying or describing 
the feelings of a character at a 
particular. time or gens eee a sida Aa 
(Character Analysis: Feelings 


69. The student wild employ character anal~ 


ysis in indicating or dascribing | the , oe 
reason for, or Justification of, a 7 3. 3 2,2 2 1; 1 
‘story character's action. (Character . . : bs 


wt 
Analysis: _Motiye or Ca a9 a 


70. The student will negoneeents the ability 
' to describe ‘and analyze charagpore by 
selecting or identifying ch acter nama, | a 5 2 2 2 

manner of speach, spacific dascfiptiva - 
santences, or by answering questions about ¢ 
choosing dascription of character traits ang ' a 
attitudes. (Character Analyaias abe . : 
basctiptive Words. Teal ts, OF Atti tudas ; 


71, ,. The Student will demonstrate the ability , eon 


“ to recagniza and define dascriptive words - : 
and phrases by identifying descriptive } XxX x 2 2 2 2 2 


words and phrases from among given ones : 

or by choosing the most appropriate re 

dascriptiveword for person or thing. : ‘ 
Moser hp tl a Words or Phrases | 


72 ‘The stodent will seudgabeabe perception “y he 
of. Sansory imagery by choosing the most 
intense or appropriate imagery for a 
, given sense; by indicating, the sense to a. 
' Which certain sensory imagas appeals or - 
by selecting the example of sensory |. - 
imagary that answers a given question: : * 
or aa aia a eter sentence. (Sensory 


Bal —— : 3 > a } 
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[s- Tha Student will recognize and employ re 
'. {dena and figurative language as ale~ 
manks of style by selecting or supplying 
_ -pakallel figures, appropriate sentence . xX 2 a” Ss & 3 
| gomaketions, or literal definitions. 
Ct ome or Flqures. OF SDB) ) acesamsemeerertetlfepren—veneremnnwenennrentiasnilsatat 


PA. The student will recognize the purpose 
of figurative language, by defining — 
-@xanples, distinguishing between literal 
t and figurative use of words, supplying X 2 2 2 32‘ 4 
 ximplesy or identifying its purpose. ; ; 
‘Jouvative Expression: Definition) tn 


156 Tha student will demonstrate tha’ ability ‘ets 
to tacognize and define similas by , = 
lowating a simile in reading material 
and chogsing its meaning or identLfying . 
“Ste wefarant; by choosing tha sentence 

gonbeining a simile; by choosing & » X 3 S if 3 
eiiniile togdefine a phrase} or by 
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76. Tha student will demonstrate. the ability. 
ho tacogniza and define metaphors by 
aglasting thet definition of metaphors 

-by Gonpleting a certain sentence with a X 3... 83 s 3 3 3 
nakaphors or by identifying a metaphor. ; ae ; 
Mataohor oe : : 


77. The student will show perception of |“ 
“mane by identifying the story elements 
that set the mood; by identifying in. ]’ 
a Akory the point at which thera tea” | 
_w+ Mgogl change; or by choosing tha mood Xx <3 3 2 2. 2 2 
_ oe that describes a story or a part of the . 


74. The student will demonstrate racognition 
of the period or time span of reading 
_.\~ matetdel by using’ whatever facta or ¥ gs & 8 2 2 2 
“glues are given to determina the period 
oy time span of the materLal, part of 
the matarial or a specified avante - ; 
fina Span and Period) Se a eee ORT Eee nec mn Oa 


79. When given a problem, the studant will - ik 
domenstrate ‘the ability to maka judg= ~ 
meyke by selecting the best solution  . | 2 2 X x X xX X 
_ fom these givens (Problem: Solution) 


BO. The atudent will demonstrate recognition 

, of bhe literary form of the.fable by xX X X , 3 az 
- ddentiPying, doscribing, or making use 

of dite (Literary Forma: Fable) 9 ft seeded eee 
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ile The student will demonstrate recognition 
‘of literary form of. the satire by : ae | . oe : 
identifying or. describing it, idantify~ AX xX CX! XR 8 38 3 
' ing the techniques. involved and their , ie ; 
effect, or by diffarentiating it from | 
Similar forms. _ Literary fox 19.3 “gatire SSE) (VRS ee ea re eee 
igs The’ student will dawcnavents racognition 
of literary form of the myth by identi« 
fying or describing, it, matching it with 
a literal explanation*or the aventa it ° me 
explains, differentiating batween myth xX Xx xX x 3 3 3 
‘and reality, or differentiating it ae ) 3 eo ae 
33 midon Ors. Abiteray Forme: Myth} eee Sea ae Sane SE 


3+ The student will distinguish betwaen 
Fantasy and reality by identifying real 
and make-believe sentences: in a group 
of santences, or by identifying real 
and make-beligve slements in a ofven . 3 
ww tory. (Reality and Fantasy) =. 2 a ye eee Ghee 


he The student. will distinguish seeueen t 
fantasy and reality in written material ’ 
_ by identifying elements in a story that X X x 4 2 2 2 
“+ gould or could not be -true. (Reality . 
and Fantasy: Possibilit 


- The student: will distinguish: batween 
. fact and. opinion by identifying or . 
" dafining elements. in reading material -— XK". YX xX 8 FY | 1 
that are fact or opinion. (fact and 
pinion 


ie The student will demonstrate racognition 

of propaganda techniques by identifying 

an author's attempt to sway the reader x X X x 2 2 2 

to a particular point of view. (Author ~ 

—lechnique: Persuasion) 

'» The student will demonstrate recognition 

of techniques used to createeffacts with 

irony or fanciful language by identify-. 

ing or defining the technique, or its 

purpose and usose (Author Tachniquas - 


+ The student will.demonstrate recagnition 
of tachnique used to create effect by 
identifying alterod syntax or by choosing 
‘a Pesponse to a question about altered syntpx. ; 
_(Author, Tochnique: Altered Syntax) ot XXX ce eS 


89- The student weld demons trata recognitian 
"cog authok: purpose, by -‘Ldantifying-the. 
_ purpose’ of -a~given salection (eege, ta 


_: entertain, to inform), or by. identifying a x so 3 & “3 
_ the techniques used by the author to ” i, 4, 7 
ee ttgin. is, PUEROB Ss. PAu tho: Py 2288, SL Le eee ee ee eee ae 
90. Thea student -will demonstrate recognition of | —_ a 


1 of symbolism by identifying .aymboles by 
selecting the'meaning of given. symbole} - 


or by/sclécting the best symbol for a ' =; 3 FS4 
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